ESVIO: Event-Based Stereo Visual Inertial Odometry
نویسندگان
چکیده
Event cameras that asynchronously output low-latency event streams provide great opportunities for state estimation under challenging situations. Despite event-based visual odometry having been extensively studied in recent years, most of them are based on the monocular, while few research stereo vision. In this letter, we present ESVIO, first visual-inertial odometry, which leverages complementary advantages streams, standard images, and inertial measurements. Our proposed pipeline includes ESIO (purely event-based) ESVIO (event with image-aided), achieves spatial temporal associations between consecutive streams. A well-design back-end tightly-coupled fused multi-sensor measurement to obtain robust estimation. We validate both have superior performance compared other image-based baseline methods public self-collected datasets. Furthermore, use our perform onboard quadrotor flights low-light environments. Autonomous driving data sequences real-world large-scale experiments also conducted demonstrate long-term effectiveness. highlight work is a real-time, accurate system aimed at
منابع مشابه
Consistency of EKF-Based Visual-Inertial Odometry
In this report, we perform a rigorous analysis of EKF-based visual-inertial odometry (VIO) and present a method for improving its performance. Specifically, we examine the properties of EKF-based VIO, and show that the standard way of computing Jacobians in the filter inevitably causes inconsistency and loss of accuracy. This result is derived based on an observability analysis of the EKF’s lin...
متن کاملDirect Stereo Visual Odometry based on Lines
We propose a novel stereo visual odometry approach, which is especially suited for poorly textured environments. We introduce a novel, fast line segment detector and matcher, which detects vertical lines supported by an IMU. The patches around lines are then used to directly estimate the pose of consecutive cameras by minimizing the photometric error. Our algorithm outperforms state-of-the-art ...
متن کاملHigh Altitude Stereo Visual Odometry
Stereo visual odometry has received little investigation in high altitude applications due to the generally poor performance of rigid stereo rigs at extremely small baseline-to-depth ratios. Without additional sensing, metric scale is considered lost and odometry is seen as effective only for monocular perspectives. This paper presents a novel modification to stereo based visual odometry that a...
متن کاملREBECQ, HORSTSCHAEFER, SCARAMUZZA: EVENT-BASED VISUAL-INERTIAL ODOMETRY1 Real-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization
Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...
متن کاملReal-time Visual-Inertial Odometry for Event Cameras using Keyframe-based Nonlinear Optimization
Event cameras are bio-inspired vision sensors that output pixel-level brightness changes instead of standard intensity frames. They offer significant advantages over standard cameras, namely a very high dynamic range, no motion blur, and a latency in the order of microseconds. We propose a novel, accurate tightly-coupled visual-inertial odometry pipeline for such cameras that leverages their ou...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2023
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2023.3269950